Learning Spatiotemporal Gaps between Where We Look and What We Focus on
نویسندگان
چکیده
When we are watching videos, there are spatiotemporal gaps between where we look (points of gaze) and what we focus on (points of attentional focus), which result from temporally delayed responses or anticipation in eye movements. We focus on the underlying structure of those gaps and propose a novel learning-based model to predict where humans look in videos. The proposed model selects a relevant point of focus in the spatiotemporal neighborhood around a point of gaze, and jointly learns its salience and spatiotemporal gap with the point of gaze. It tells us “this point is likely to be looked at because there is a point of focus around the point with a reasonable spatiotemporal gap.” Experimental results with a public dataset demonstrate the effectiveness of the model to predict the points of gaze by learning a particular structure of gaps with respect to the types of eye movements and those of salient motions in videos.
منابع مشابه
Reflection for the undergraduate on writing in the portfolio: where are we now and where are we going?
Introduction: The portfolio can be seen as a tool for assessmentof a variety of learning activities that differ in content, usage, andassessment. The portfolio not only meets the learner’s educationalneeds but also the political and public reassurance demand thatthe health professional has achieved the required competency ofthe curriculum that allows him or her to practice safely with orwithout...
متن کاملI-36: Preimplantation Genetic Diagnosis - Where Have We Been and Where Are We Going
Preimplantation genetic diagnosis (PGD) is now considered routine in IVF laboratories with micromanipulation capability and access to genetic diagnostic services. The past two decades have witnessed a dramatic increase in the use of PGD, the number of cycles performed, and the indications for which PGD has been used. This increase has been mirrored by a slow, but steady, increase in the range o...
متن کاملInformation commons: future of academic libraries
Background and Aim: This paper seeks to explore the concepts of the information commons (IC). The paper provides a look at the models and characteristics of the IC. A number of projects of the IC are presented. We will discuss the situation of an existing traditional library. It makes recommendations for converting an existing library space into an IC. A number of Challenges of implementation o...
متن کاملBelievable Visual Feedback in Motor Learning Using Occlusion-based Clipping in Video Mapping
Gait rehabilitation systems provide patients with guidance and feedback that assist them to better perform the rehabilitation tasks. Real-time feedback can guide users to correct their movements. Research has shown that the quality of feedback is crucial to enhance motor learning in physical rehabilitation. Common feedback systems based on virtual reality present interactive feedback in a monit...
متن کامل-
The development and evolution of any system–person, organization–nation depends on how the system succeeds to bridge the gap between what the system knows and what the system does (with the knowledge). We call this the gap between knowing and doing or the knowing-doing gap. If the system does not do what it knows, it will lose out in competition with other systems, its relative performance in...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- IPSJ Trans. Computer Vision and Applications
دوره 5 شماره
صفحات -
تاریخ انتشار 2013